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Abstract — There are two gradient descent decoding procedures 
for binary codes proposed independently by Liebler and by 
Ashikhmin and Barg. Liebler in his paper 1 15 1 mentions that both 
algorithms have the same philosophy but in fact they are rather 
different. The purpose of this communication is to show that 
both algorithms can be seen as two ways of understanding the 
reduction process algebraic monoid structure related to the code. 
The main tool used for showing this is the Grobner representation 
of the monoid associated to the linear code. 

I. Introduction 

From now on a code C will be a binary linear code of length 
n and dimension k, i.e. a fc-dimensional linear subspace of 
F2 where F2 is the field of two elements. Let d(-, •), wt(-) 
be the Hamming distance and the Hamming weight on 
respectively. Let d denote the minimal Hamming distance of 
the code C. 

Given a code C and let r be a received word in F2 the 
complete decoding problem (CDP) addresses to determine a 
codeword c G C that is closest to r. The t-bounded distance 
decoding problem (t-BDP) is to determine a codeword c e C 
such that (i(r, c) <t if such codeword exists. If t — [-^^^y^J 
then the solution of the i-BDP is unique and if t = p the 
covering radius then t-BDP is the same as CDP. Both problems 
are quite related to the coset weights problem (i-CWP) that 
can be stated as follows, given a binary r x n matrix and an 
r-dimensional vector s and t G Z>o, does a binary vector 
e G F'2 exist such that w{e) < t and He ~ s? All these 
problems have been shown to be NP-complete Q, ([3] even if 
preprocessing is allowed |10|. 

Recently complete decoding and particularly gradient de- 
scent complete decoding have gain new interest related to the 
decoding of LDPC codes, in fact Liebler in 1 15 1 says that there 
is not a clear answer to the question of which parameters of 
a code could help to recognize and to implement a gradient 
descent decoding function for the code having the the coset 
leaders as output. Moreover in the same paper the author 
makes a distinction between two gradient descent decoding 
algorithms (GDDA) that we will denote by leader GDDA 
(1-GDDA) and test-set GDDA (ts-GDDA) that are claimed 
to be different (see section for formal definitions of the 
algorithms). 

The purpose of this work is to show that both algorithms can 
be seen as two ways of understanding the reduction process 
within algebraic monoid structure related to the code. For that 



aim the main tool used will the Grobner representation of 
the monoid associated to the linear code [4|. The structure 
of the paper will be as follows. Section HI] will show the 
two gradient descent decoding algoritms. Section [III] will give 
a brief review to the Grobner representation of a code and 
its associate structures. Secion |IV] will show the main result, 
i.e. how the two GDD algorithms can be seen as reduction 
associated to the Grobner representation of the code. 

II. Gradient descent decoding algorithms 

In this section we will briefly describe two gradient descent 
decoding algorithms. The first one will be the leader GDDA 
and can be stated as follows. Let us denote by y the coset in 
F2 /C containing y and wt(y) the weight of one of its leaders. 

Algorithm 1. l-GDDA 

Input: r the received word. 

Output: A codeword c G C that is closest to r 

Repeat until wt(r) = 

a) Compute r' such that wt(r — r') = 1 and 
wt(r) > wt(F) 

b) r <— r' 
Return c = r. 

Note that in each of the steps of the algorithm the vector 
r changes between different cosets of Fj /C until it arrives to 
the coset, i.e. the code itself. This is essentially the same 
as syndrome decoding broken up in smaller steps. The paper 
1 15 1 presents the first such construction method of a gradient 
function 7 : Fj/C Z such that is a strictly increasing 
function of wt(m) for performing such a 1-GDDA. 

For understanding the next GDD algorithm we will need 
some knowledge of minimal (support) codewords. The support 
of a codeword c G C will be the set of its non-zero positions, 
i.e. supp(c) — {i\ci ^ 0}. 

Definition 2. A codeword m in the code C is said to be 
minimal if there is no other codeword c G C such that 

supp(c) C supp(m). 

We will denote by Mc the set of all the minimal codewords 
of C. The usual way of defining a steepest descent method in 
the Hamming space is to construct a test set T C Fj . A test 
set is a set of codewords such that every word y either lies in 
V{Q) (the Voronoy region of the all-zero vector) or there is a 



t e T such that wt(y — t) < wt(y). The gradient-like or test 
set GDDA is stated as follows (see f2l| for further details and 
correctness of the algorithm) 

Algorithm 3. ts-GDDA 

Input: r the received word. 

Output: A codeword c G C that is closest to r 

c ^ 

Repeat until no t £ T is found such that 
wt(r — t) < wt(r) 

a) c ^ c + t 

b) r ^ r - t 
Return c. 

It is pointed in f2] that setting T = AAc in the previous 
Algorithm [3] the so call minimal vector algorithm performs 
complete minimum distance decoding. 

III. Grobner representation and related 

STRUCTURES 

In this section we will show some basic results on the 
Grobner representation of a code C. In fact it is related to 
the additive representation of the monoid /C We will try to 
keep this section as Grobner basis technology-free as possible. 
For some references on Grobner representations of codes and 
its implementations see H, Q, IS], Q. Let e be 
the vector with all its entries but a 1 in the ith-position. 

Definition 4. A Grobner representation of F2/C is a pair 
N,(l) where is a transversal of the cosets in V^/C (i.e. 
one element of each coset) such that Q £ N and for each 
n £ N \ {0} there exists a e^, j G {1, 2, . . . , n} such that 
n = n' + Gi with n' G TV and a mapping 

(f): N X {ei,e2, . . . ,e„} ^ 

such that the image of the pair (n, e;) is the element repre- 
senting the coset that contains n + e;. 

The word Grobner is not casual as we will see it with the 
following construction. Let us consider the binomial ideal 

Xc = ({x''-i - x'^"'^ I wi - W2 G C]) C K[a;i, . . . ,x„] 

(1) 

where the characteristic crossing function A : — > Z" 
replaces the class of 0,1 by the same symbols regarded as 
integers; K is an arbitrary field and if Aw — {wi, . . . ,Wn) 
then x*^ = n^r'- consider a degree compatible 

ordering -< and we compute a Grobner basis w.rt. -< of the 
ideal the normal form of any monomial Yl xf^ corresponds 
with the syndrome of the word ▼(u'l, . . . , w„) where the map 
T is reduction modulo 2. Thus we can take A^ in Definition |4] 
as the vectors j{wi, . . . ,Wn) such that H^™' ^ normal 
form w.r.t. Q^, i.e. the syndromes of the code. Note also that 
(j> is just given by the multiplication tables of the normal forms 
times the variables Xi in the ring K[a;i, . . . ,x„]/2c- This is 
standar way of representing the quotient by an ideal Ic using 
the FGLM algorithm (see [il7j chapter 29 for a complete 



reference on Grobner basis topics). Moreover, the Grobner 
representation of a code can be computed with a modification 
of the FGLM algorithm [SJ, one implementation in GAP 1, 11 J 
of this algorithm can be found in I?]. 

The binomial ideal Iq can be seen also as a kernel of a 
modular integer linear program problem stated as follows. Let 
H G Z™^" be a m X n matrix such that JH is a parity check 
matrix of C and b G Z". 

r min{(l,l,...,l).u*} 
IPnih) = i ugZ>o (2) 
[ iJ • u* = bmod2. 

Ikegami and Kaji fT2| studied the kernel of this problem 
related with the maximum likelihood decoding problem. It has 
been also studied in lfT6l in order to describe the combinatorics 
of the minimal codewords of the code C. 

Associated to the Grobner representation we can define the 
border of a code [|9] as follows 

Definition 5. Let C be a code and H a parity check matrix of 
C, let {N, (f)) be a Grobner representation of /C Then the 
border of the code C w.r.t. (A^, (j)) is the set 

B{C) = {(ni + Gi, n2) I i G {1, . . . n}, rii + e, 7^ n2, 
rii, n2 G A^ and H ■ (rii + e^) = H ■ , 

(3) 

An important remark is that both components of an element 
in the set B{C) are in the same coset, i.e. their sum is in the 
code. We can also describe the border in as 

B{C) = {(n + e„ 0(n, e,)) | ^ G {1, . . . n}, n G A^}\{(x, x)}. 

(4) 

The border of a code B{C) is associate to the border 
basis of the ideal Ic- The conection between the ideal 
comes from the well known fact that that every Grobner 
basis with respect to a degree-compatible term ordering can 
be extended to a border basis (see ||T41 p. 28 Iff]) but not 
every border basis is an extension of a Grobner basis. The 
preference of border bases over Grobner bases in our case 
arises from the iterative generation of linear syzygies, inherent 
in the linear algebra algorithm used in fS], which allows for 
successively approximating the basis degree-by-degree, i.e. 
weight-by-weight. 

IV. Gradient descent decoding and reduction 

Given a code C and its corresponding Grobner representa- 
tion (A^, (j)) we can accomplish two types of reduction that we 
will see are associated to Algorithms [T] [3] above. Thus both 
algorithms obey to the same algebraic structure. 

A. Reduction by 4> 

We shall define the reduction of an element n G A^ w.r.t. 
as the element n' — (j){n, e^) and we will denote it by n — )-j n'. 
For each y G Fj , y = + J2j ^ij for some ij G {1, ■ • ■ n}, 
thus we can iterate a finite number of reductions to find the 
representative of the coset y containing y. Note that in the case 
that we use -< defined above the representatives of the classes 
corresponds with coset leaders, we will consider that this is 



the case from now on. This gives us the following gradient 
descent decoding algorithm. 

Algorithm 6. {N, 4>)- reduction GDDA 
Input: r the received word. 
Output: A codeword c G C that is closest to r 

Forward step 

r = X^J^i^jj- Compute n E N corresponding to the 
coset r, i.e. 

a) n = 0. 

b) For j = 1, s do 

n -^i- n', n n' 

Backward step 

While n ^ 

a) Compute r' such that r' = r + e^^. and 

wt(n) > wt(0(n,ei^.)) 

b) r ^ r', n ^ 0(n, J. 
Return: c = r. 

Note that the previous algorithm is somehow redundant, 
since at the end of the forward step we end with the coset 
leader n of the class r, thus we can decode without perform- 
ing the forward step. Anyway we have staded this way to 
see the resemblance with Algorithm [T] We can modify our 
algorithm capturing the needed information of the Grobner 
representation as follows. 

Definition 7. Let [N, (f)) Grobner representation of Fj/C and 
{ni}^^]^ an ordering on N with rii = 0. We will denote by 
{N*, (j)*) the following pair. 

TV* - {{i, w,) e Z|o I = wt(ni), i = 2"-'=} 

(j)* : TV* X {ei,e2,...,e„} iV* 

{i,w,) (j>*{{i,Wi),ej) 

such that (l)*{{i,Wi),ej) = (ij.Wi^) if n^^ = (j>{ni,ej) and 

In other words, we keep track only on the ordering of the 
normal forms representing each coset and the weight of one of 
its leaders. Note that {N*,(f)*) can be easily computed from 
a Grobner representation (iV, 0) w.r.t. a degree compatible 
ordering -< since for -< the normal forms are coset leaders. 
Moreover, the way of computing a Grobner representation by 
FGLM techniques gives us an incremental construction of N* 
ordered non-decreasingly on the second component (see |4| 
for further details), i.e. 

(i, Wi), {j, Wj) G N* and i < j ^ Wi < Wj. 

Now it is clear that we can decode using only {N*,ip*), 
thus we can avoid storing the normal forms in the Grobner 
representation. 

Algorithm 8. (iV*, (j)*)-reduction GDDA 
Input: r the received word. 



Output: A codeword c G C that is closest to r 
Forward step 

r — X]j=i ^ij- Compute G {1, . . . , 2"^*^} correspond- 
ing to the coset r, i.e. 

a) i ^ 1, wi — 0. 

b) For j = 1, s do 

Return i — L 
Backward step 

While i ^ 1 

a) Compute r' such that r' = r + e^^. and 

Wi > w[ 

where w[ is the second component of 

b) r^r', {i,Wi) ^ 4)*{{i,Wi),e,.). 
Return: c = r. 

As an intermediate result, from the forward step we already 
know if the coset has a correctable leader ifwi <t — [ ^'^^"'"-' j , 
in that case the backward step gives us a unique solution, if £ > 
t then there could be multilple ways of doing the backtracking 
step depending on the number of leaders in the £th-coset. Also 
this algorithm can be use to answer the i-CWP problem. 

Note that the backward step is just the 1-GDDA in Al- 
gorithm [T] As pointed by Liebler |15 | in each step of the 
backtracking procedure we change of coset till we arrive to 
the coset. 

B. Border reduction 

Now taking into account the information on the border of 
the code B{C), we can make a similar reduction substituting 
in each step the first component of an element of the border 
by the second one. More formally, let (bi,b2) = b G B{C), 
we define the head and the tail of b as 

head(b) = bi, tail(b) = bz G F^. 

As pointed before head(b) + tail(b) is a codeword of C 
for all b G B{C) and by its definition (O it is clear that 
the information in the border allows complete decoding. The 
information in the border is somehow redundant, we can 
reduce the number of codeword in it needed for decoding. 

Definition 9. A set R{C) is the reduced border for the code 
C with respect to the order ^ if R{C) C B{C) and it fulfills 
the following conditions: 

1) For each pair (n, Gj) such that n + is a head in B{C) 
there exists an element in R{C) such that its head is h 
where 

supp(h) C supp(n + e^). 

2) Given two elements in R{C) and hi , h2 their heads, 
then we have that 

supp(hi) g supp(h2) and supp(h2) g supp(hi). 



Thus R{C) is the set with smallest cardinal that allows us a 
gradient-like test set decoding using reductions. 

Proposition 10. Let us consider the set of codewords in C 
given by 

Min^ed(C) = {head(b) + tail(b) | b e R{C)} C C. (5) 

Then Minted (C) C Mc- 

Proof: Let head(b) + tail(b) = c where b e R{C) 
and suppose c ^ Aic, then there exists c' G C such 
that supp(c') C supp(c). Let Ci be a vector such that 
supp(ci) ~ supp(c) n supp(head(b)), thus C2 = c — Ci 
fulfills supp(c2) C supp(tail(b)). Let m be the maximum 
between Ci and C2, therefore supp(m) C supp(c), and m is 
smaller than hGad(b) and tail(b) which contradicts the fact 
that R{C) is reduced. 

■ 

Therefore the set Minted (C) is a minimal test set w.rt. the 
order -< given by minimal codewords that allow the ts-GDD 
algorithm stated in Algorithm |3] It can be also seen as a test 
set for the modular integer program in Equation (|2]l. 

Conclusions 

We have shown an unified approach via the Grobner presen- 
tation of a code to two gradient descent decoding algorithms, 
one that the search is done changing the coset representative 
(1-GDDA) and the one given by descending within the same 
coset (ts-GDDA) that were claimed to be of different nature. 
This two algorithms come from two ways of computing the 
reduction of a monomial modulo a binomial ideal associated 
to the code. Unfortunately there are some obstructions for 
generalizing this approach in a straightforward way to non 
binary codes mainly motivated by the non-admissibility of the 
ordering needed for decoding (see |4|). Further research lines 
of the authors point to generalizing the border basis for the non 
binary case in order to describe the set of minimal codewords 
of a code. 
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